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Abstract 

We present two collective games with new paradoxical features when they are com- 
bined. Besides reproducing the so-called Parrondo effect, where a winning game is 
obtained from the alternation of two fair games, a new effect appears, i.e., there 
exists a current inversion when varying the mixing probability between the games. 
We present a detailed study by means of a discrete-time Markov chain analysis, 
obtaining analytical expressions for the stationary probabilities for a finite number 
of players. We also provide some qualitatively insight into this new current inversion 
effect. 
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1 Introduction 



In the past few years there has been an increasing interest in what is known in 
the literature as Parrondo's paradox [1,2]. This phenomenon shows that the 
alternation of two fair (or even losing) games can result in a winning game. 
These so-called Parrondo games were originally defined as follows: Game A 
is a simple coin tossing game, where the player wins or loses one coin with 
probabilities p A and 1 — p A respectively. For game B the winning probabil- 
ity depends on the capital of the player modulo three, governed by the set 
of probabilities {p^iPbiPb}- In the (stochastic) combination of these games, 
either game A or B is played, with probabilities 7 and 1 — 7 respectively. The 
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games are said to be fair /losing/winning when on average the player's capital 
stabilizes/ decreases/increases. 

In the Parrondo games, to which we will further refer as the original game A 
and B, the following parameter values were used: p A = | — e, p l B = — e, 
Vb = V% = f — e - When e = both games A and B played separately are 
fair, whereas if e > both games turn out to be losing. The Parrondo effect 
appears when the stochastic (0 < 7 < 1) or periodic combination of these 
fair/losing games results in a winning game. 

These games were first devised in 1996 by the Spanish physicist Juan M. R. 
Parrondo, who presented them in unpublished form in Torino, Italy [3]. They 
served as a pedagogical illustration of the flashing ratchet [4], where directed 
motion is obtained from the random or periodic alternation of two relaxation 
potentials acting on a Brownian particle, none of which individually produce 
any net flux. Only recently a quantitative relation has been established be- 
tween the Brownian ratchet and Parrondo's games [5,6]. 

Cooperative versions of the games, played by a set of N players, have also 
been studied. In [7], a set of N players are arranged in a ring and each round 
a player is chosen randomly to play either game A or B. The original game A 
is combined with a new game B, for which the winning probability depends 
on the state (winner/loser) of the nearest neighbors of the selected player. A 
player is said to be a winner (loser) if he has won (lost) his last game. In [8] 
again a set of N players is considered, but for this case game A is replaced by 
a redistribution process where a player is chosen randomly to give away one 
coin of his capital to another player. When combining this new game with the 
original game B, the paradox is reproduced. 

In this work we present a new version of collective games, where besides ob- 
taining the desired result of a winning game out of two fair games, a new 
feature appears. The games show under certain circumstances a current in- 
version when varying 7, i.e. the value of the mixing probability 7 determines 
whether you end up with a winning or a losing game A + B. To our knowledge, 
this effect is new in the literature on paradoxical games, and in the related 
field of Brownian ratchets, as we will discuss in Sec. 3. 



2 The games 

The games will be played by a set of N players. In each round, a player is 
selected randomly for playing. Then, with probabilities 7 and 1— 7 respectively 
game A or B is played. Game A is the original game in which the selected 
player wins or loses one coin with probability p A and 1 — p A respectively. The 
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winning probabilities in game B depend on the collective state of all players. 
Again, as in [7], a player is said to be a winner or a loser when he has won 
or lost respectively his last game. More precisely, the winning probability can 
have three possible values, determined by the actual number of winners i 
within the total number of players N, in the following way 



pf 



probability to win in game B 



p\ if 

,2 



pi if[fi<,<rfi, 
<<rfi. 



Pb if 



where the brackets \x] denote the nearest integer to the number x. 



2.1 Analysis of the games 



The main quantity of interest is the average gain of the collection of N players 
when playing the stochastic game A+B. Since the winning probability of game 
B only depend on the total number of winners, it is sufficient to describe the 
games using a set of iV + 1 different states { <t , <7i, . .., cr N }. A state a { is 
the configuration where % players are labeled as winner and N — i as loser. 
Transitions between the states will be determined by the forward transition 
probability Pi, the backward transition probability qi, and the probability for 
remaining in the same state rj, see Fig. 1. 




Figure 1. Different states and allowed transitions for N players. The arrows indicate 
the state of each player being a winner (arrow up) or a loser (arrow down). 

Denoting as Pi(t) the probability of finding the system in state o~i at the t-th 
round played, we can write the equation governing its time evolution as 

Pi(t + 1) = Pi-iPi-i(f) + nP t (t) + q i+1 P i+1 (t), (2) 

with < i < N and where the transition probabilities are given by 
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Pi 



M — i 

" " 7P A + (l-7)pf , (3) 



N 
2i-N 



Ti = 



N 

i 



i N — i 

1P A +(1-1)P?}+—, (4) 



*=N 



7(1-^) + (l- 7 ) (1-pf) • (5) 



The set of transition probabilities (pj,(fr,rj) must satisfy the normalization 
condition pi + r\ + qi = 1, which implies for the probabilities -Pj(t) that 
Elo Pi(t) = 1, as long as E,= = 0) = 1. 

This system of AT + 1 equations can be solved in the stationary state, where the 
probabilities no longer depend on time Pi(t) = P^, and the general solution 
reads 



= t^Po Pi ■ ■ -Pi-i Qi+i Qi+2 ■ ■ ■ Qn, (6) 

where < % < N and Z is the normalization factor. Once the stationary 
probabilities are calculated, we can obtain the average winning probability 
over all states for the stochastic combination A + B (mixing probability 7) 
from 



N 

pit B = H[ip A + ^-i)pf]pf- (7) 

i=0 

The average gain can then easily be evaluated through the expression 

JA+B = 

2Pwin B — 1- The properties of the separate games A and B can be obtained by 
replacing in the previous expressions 7 by 1 or respectively. 



2.1.1 The Parrondo effect 

The Parrondo effect appears when from the combination of two fair games, 
we obtain a winning game. Clearly, game A is fair for p A = 1/2. For game B 
the set of values {PbiPb-iPb} giving a fair game is more difficult to determine 
because it depends on the total number of players N . The conditions on p\ 
for a fair game B have been found analytically by a symbolic manipulation 
program up to < 13. In Table 1 we find listed the conditions of fairness for 
p 2 B up to A^ = 5. When playing only game B (7 = 0), the following symmetry 
in the stationary distribution can be deduced from Eq.(6) 



pSt,{p^,p|,p|} _ p^,{l-p|,l-p|,l-p^} ^ 
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Pi 



(P B -1)(P|+1)+V(P B -2)(P^-1)P|( P |+1) 



(P^-1) 2 (P|+1) 
1+P B + (P S -2)(P^+P^P|-(P^) 2 ) 



5+2p^(p^-3) 
P^TV l+2p3 (l+p») 



-1 



Table 1 

Condition on in order that game B is fair for N = 2, . . . , 5. 
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Figure 2. a) Plot of the current versus the mixing probability 7 between games A 
and -B for ./V = 4 with probabilities p A = \, Pb = 0.79, = 0.65 and p 3 B = 0.15. 
b) Plot of the current versus the mixing probability 7 between games A and B for 
N = 3 with probabilities p A = \,p\ = 0.686, p| = 0.423 and p| = 0.8. 



This property implies that p^fj 3 is unaffected by the parameter transforma- 
tion: {Pb,PbiP%} ~~ * {1 — Pbj 1 ~~ Fb; 1 ~~ Pb}- ^ a ls° means that for the 
parameter set {p B ,p B = 1/2, 1 — p B }, the stationary probability distribution 
is symmetric over the states, i.e. Pf" = fjv-r Therefore, when combining this 
with game A, i.e., alternating two games with symmetric probability distri- 
butions, always yields a fair game, independent of the values of 7, N and p B . 
To see the Parrondo effect, we need another, non-trivial, parameter set which 
yields a fair game B. For example, for N = 4 we obtain a fair game B when 
p l B = 0.79, p\ = 0.65 and p\ = 0.15. The stochastic combination with game 
A reproduces the desired Parrondo effect, see Fig. 2. a . 
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2.2 Results 



2.2.1 Two players 

For N = 2 players, there are 3 different states. Fig. 3. a shows the regions in 
parameter space {l,P B ,P B } where the mixing (0 < 7 < 1) between games A 
and B results in a fair, winning or losing game. Note that p 2 B is fixed by the 
condition to have a fair game B, see Table 1. Besides the case p B = 1 — p B , 
valid for any number of players, also p l B = p B results in a fair game for N = 2, 
independent of the alternation probability 7. From Eq. (6), one can deduce 
that p B = p B and p B = 1 — p B imply a symmetric distribution P?* over the 
states, i.e. Pq* = P|*. As mentioned before, this property prohibits any net 
current in the system. For all other values of p B and p 3 B the Parrondo effect 
appears, that is, game A + B is either a winning or a losing game, cf. Fig. 3. a. 




Figure 3. a) N = 2. The regions in parameter space for for which p^^ 8 = 0.5, 0.499 
and 0.501, indicating the regions where A-\-B is fair (blue), losing (red) and winning 
(green) respectively. The blue diagonal planes show the situations p B = l—p B and 
Pb = P%-> f° r w hich A + B is fair, independent of 7. b) N = 3. The regions in 
parameter space for which the mixing (0 < 7 < 1) between game A and B results in 
a fair game. Besides the trivial diagonal plane, there is a curved plane - not uniform 
in 7 - for which J A+B = 0. 

2.2.2 Three players 

Fig. 3.b shows for iV = 3 the surfaces in parameter space {7 ,Pb,Pb} where 
A + B is a fair game. Besides the plane p B = 1 — p 3 B , there is a second, curved 
surface with values of 7 different from and 1 which results in J A+B = 0. This 
curved surface is not uniform in 7 and is therefore the collection of points of 
flux reversal between a winning and losing game A + B. This implies that, 
depending on the value of 7 we can either have a winning game or a losing 
game by alternating between two fair games. For example, in Fig. 2.b we have 
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plotted the current J A+B vs. 7 for the set of probabilities p A — |, p B — 0.686, 
p\ = 0.423 and p 3 B = 0.8. For low values of 7 the resulting game is a losing 
game, whereas for high values of 7 the game turns to be a winning game, cf. 
Fig 2.b. In both regions there exists an optimal value for 7 giving a maximum 
current. We can provide a qualitative picture that may help understanding 
the mechanism by which the current inversion phenomenon takes place. 

When playing exclusively game B (7 = 0), the stationary distribution Pf is 
not homogeneous. This is reflected by the fact that the central states {<7i, <t 2 } 
have a higher occupancy probability (Pf*) than the boundary states {<Jo,<T3}. 
On the other hand, if we look to the winning probability, it is higher in the 
latter set of states rather than in the former one (p B ,p 3 B > p%). 

Indeed, the central states can be labelled as losing states, as when combining 
game B with game A for any < 7 < 1, the average losing probability 
p\ = 7(1 — p A ) + (1 — 7)(1 — pf) < |, i.e., it is more likely on average for a 
player to lose money rather than to win when being in one of these states. On 
the other hand, for the boundary states the contrary is true: it is more likely 
to win money rather than to lose for any < 7 < 1, so we can refer to them 
as winning sites, i.e., pf = r yp A + (1 — j)pf > \. 

When combining game B with A, the resulting game will be fair, losing or 
winning depending on the net balance between the occupancy probabilities 
and the average winning probability on each set of central and boundary states. 
For low 7 values (playing game B more often), the high occupancy probability 
of {(Ti,^} is the dominant part, and due to the low winning probability on 
these sites the resulting game is a losing game. On the contrary, for higher 7 
values (playing game A more often), the winning probability on the boundary 
sites {<T , 03} is high enough to compensate their low occupancy, resulting in 
a winning game. 

2.2.3 N players 

For a general number of players, we have not been able to find the analytical 
expressions for a fair game B. Nevertheless, we will show numerically that 
the results for N = 3 are representative for any N. This is illustrated by 
Fig. 4, where the parameter space {pbiPb} giving a fair game B is shown, 
corresponding to a fixed p B = 0.4 and different values of N. As shown, the 
different curves seem to converge to a limiting curve as N increases. Note that 
all curves intersect at the trivial point {p B = 0.4, p\ = 0.5, p\ = 0.6}. 

We can also obtain the parameter space where the current inversion takes 
place, for different values of N. For clarity reasons we show in Fig. 5 only 
a vertical slice corresponding to a fixed 7 = 0.4, and different values of N. 
Again, the regions for which a flux inversion exists, doesn't seem to depend 
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Figure 4. Plot of the parameter space {p%,p%} for a fixed p\ = 0.4 that gives a 
fair game B for different values of N = 3, 10, 30, 50, 100, 200 and 300. As it can be 
seen, the curves seem to converge to a limiting curve as N increases. 
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Figure 5. Plot of the points in parameter space {Pb,P%} where (for 7 = 0.4 fixed) 
A + B is a fair game. Results for different values of the total number of players 
N = 3,4, 10, 20, 30, 40 and 50 are shown. The diagonal line shows the common 
plane p B = l — p B , that corresponds to a fair game B for any number of players N. 

much on N. The only exception is N = 4, for which the curve bends in the 
other direction. This is a consequence of the fact that for N = 4 there exists 
only one state (namely 02) where the probability p 2 B is used. This is confirmed 
by our findings when we modify the definition of game B such that there 
is for any iV only one state where p\ is used. The fact that all curves of 
inversion points are symmetric upon reflection about the plane p B = 1 — p B 
is a consequence of the property of Eq. (8). 
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3 Parrondo's games and the current inversion 

As stated previously, in the original Parrondo games the effect of a current 
inversion when varying the mixing probability 7 is not possible. One way of 
understanding the reason is by means of the relation that has been estab- 
lished recently [5,6,9] between the Brownian ratchet and Parrondo's games. A 
fair or unfair paradoxical game corresponds to a periodic or tilted potential 
respectively in the model of a Brownian ratchet. 




Figure 6. a) Plot of the potential related to the original Parrondo game B ob- 
tained with the relation described in [5]. b) Effective potential that we obtain when 
alternating between the original Parrondo games A and B with probability 7 = |. 

As an illustration, we have depicted the potential corresponding to the original 
game B in Fig. 6. a. If we now combine game B with A -which would have an 
associated flat potential- with a certain probability 7, the potential obtained is 
no longer periodic, i.e., it is tilted to the right in agreement with the direction 
of the flux, see Fig. 6.b. Therefore, the question now reduces to explain why 
there is no current inversion in the flashing ratchet model when varying the 
rate of alternation between the potentials. 

a) 

ON 




Figure 7. Different stages of the mechanism of rectification when switching a ratchet 
potential on and off. 
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In the flashing ratchet model, the appearance of a flux when alternating be- 
tween a flat and an asymmetric potential is due to a rectification process: if we 
consider a bunch of Brownian particles subjected to a ratchet potential, they 
will tend to remain in the potential well for a sufficiently small temperature 
-see Fig. 7. a . When the potential is switched off the particles start diffusing, 
and if we wait for long enough, it is more likely that a small fraction of par- 
ticles will reach the vicinity of the potential well located to the right, rather 
than the one on the left, due to the geometry of the potential. Switching on 
and off the potential many times, generates a net flux to the right. Whence, 
whatever the rate of alternation between these two potentials, it will always 
be more likely for a particle to move rightwards rather leftwards. Therefore it 
will be impossible to obtain a current reversal by means of varying only the 
flip rate of the potentials. 



4 Conclusions 

We have presented a new type of collective Parrondo games. These games 
present, besides the Parrondo effect, a current inversion when varying the 
alternation probability 7 between the two games A and B. This phenomenon 
is new in the literature on paradoxical games and the related ratchet models. 
Analytical expressions for the games have been obtained for a finite number of 
players using discrete-time Markov chain techniques. We have also explained 
qualitatively the reason of this current inversion. 

It remains as an open question the possible implications of these findings in 
the field of the Brownian ratchet, as well as the possibility of finding a physical 
model equivalent to this collective game. 
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